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Abstract 

Sliced Sudoku-based space-filling designs and, more generally, quasi-sliced orthogo¬ 
nal array-based space-filling designs are useful experimental designs in several con¬ 
texts, including computer experiments with categorical in addition to quantitative 
inputs and cross-validation. Here, we provide a straightforward construction of 
doubly orthogonal quasi-Sudoku Latin squares which can be used to generate sliced 
space-filling designs which achieve uniformity in one and two-dimensional projec¬ 
tions for both the full design and each slice. A construction of quasi-sliced orthogonal 
arrays based on these constructed doubly orthogonal quasi-Sudoku Latin squares is 
also provided and can, in turn, be used to generate sliced space-filling designs which 
achieve uniformity in one and two-dimensional projections for the full design and 
and uniformity in two-dimensional projections for each slice. These constructions 
are very practical to implement and yield a spectrum of design sizes and numbers 
of factors not currently broadly available. 

KEY WORDS: Computer experiments, space-filling designs, Sudoku, sliced experimental 
designs. 


1 



1 Introduction 


In the popular game Sudoku, players are presented with a nine-by-nine array, divided 
into nine three-by-three subsubarrays, and partially hlled with the numbers 1 through 9. 
The goal is to £11 the nine-by-nine array with the numbers 1 through 9 so that each row, 
column, and three-by-three subarray contains no repeated numbers. See a starting and 
completed Sudoku square in Figure [8]. 


1 

4 

9 

7 

3 

5 

8 

2 

6 

8 

2 

6 

9 

1 

4 

7 

3 

5 

3 

5 

7 

8 

2 

6 

9 

1 

4 

5 

8 

1 

2 

7 

3 

4 

6 

9 

2 

6 

3 

4 

9 

8 

1 

5 

7 

9 

7 

4 

6 

5 

1 

3 

8 

2 

7 

3 

5 

1 

4 

2 

6 

9 

8 

4 

1 

8 

5 

6 

9 

2 

7 

3 

6 

9 

2 

3 

8 

7 

5 

4 

1 


8 

7 3 5 

1 

2 6 

8 2 

5 

1 

8 1 

7 

9 

6 

9 

5 

9 

5 

3 8 

3 

1 4 


4 

6 

3 

9 2 

3 8 7 



Figure 1: A starting and completed Sudoku square [Hj- 

Sets of (completed) Sudoku squares, as well as generalizations thereof, can be used to 
construct sliced space-filling designs achieving maximal uniformity in both one and two- 
dimensional projections for both the complete design and each subdesign, or slice. Sliced 
space-filling designs are experimental designs which can be partitioned into groups of 
subdesigns so that both the full design and each subdesign achieve some type of uniformity. 
These types of designs are broadly useful for collecting data from computer experiments, 
large and time-consuming mathematical codes used to model real world systems such 
as the climate or a component in an engineering design problem. Sliced space-filling 
designs are particularly useful for computer experiments with qualitative and quantitative 
inputs [5], multiple levels of accuracy |3], and cross-validation problems in the context of 
computer experiments [10]. Sudoku-based sliced space-filling designs were introduced in 
[9] and a construction was given using doubly orthogonal Sudoku squares, whose complete 
arrays are orthogonal and whose subarrays are orthogonal after a projection. In |9], doubly 
orthogonal Sudoku squares were constructed using the techniques developed in |1] along 
with a subfield projection. 

Here, we give a straightforward construction of doubly orthogonal guasi-Sudoku squares 
relying on the existence of sets of orthogonal Latin squares, which are relatively well- 
described and available for a broad range of sizes HIEIE]. Further, the presented con¬ 
struction of sliced Sudoku-based space-filling designs is available for a spectrum of sample 
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sizes and number of factors combinations. The remainder of this article is organized as fol¬ 
lows. Section [^provides notation and dehnitions which will be used throughout. Sectionj^ 
provides a construction for sets of pairwise doubly orthogonal quasi-Sudoku Latin squares 
which is based on sets of orthogonal Latin squares. Section illustrates the presented 
techniques with an example. Section notes the connection with quasi-sliced asymmet¬ 
ric orthogonal arrays. Finally, Section reviews the construction of Sudoku-based sliced 
space-hlling designs from [9]. 


2 Notation and Definitions 

Let [n] = {0,1,..., n — 1} and A = [A{i, j)] be a Latin square of order n; that is, an n x n 
array in which each of the entries in a set N (usually [n]) of size n occurs once in every 
row and once in every column. Two Latin squares A = [A{i,j)] and B = of the 

same order, are said to be orthogonal if, when we superimpose one on top of the other, 
the arrays contain each of the ordered pairs {x,y), x,y E N exactly once. It is useful 
to note that A and B are orthogonal if and only if for all p,q, s,t ^ N 

A{p,q) = A{s,t) B{p,q) ^ B{s,t)- 

Let A = [A{i,j)] and B = [B{i,j)] be two orthogonal Latin squares of order n. For n = s^, 
let n denote a projection from to [s], fl : iV —)■ [s], and let O = {(n(y4(i, j)), Il{B{i, j))) \ 
i,j G N}. We may think of (9 as an n x n array obtained by superimposing n(y4) and 
n(i?). The Latin squares A and B are said to be doubly orthogonal if there exists a 
projection fl such that O can be partitioned into s x s subarrays with the cells of each 
subarray containing the ordered pairs {x,y), 0 ^ x,y ^ s — 1. For n = rs, let fl^ 
denote a projection from iV to [r]. If,, : iV —)■ [r], let fl^ denote a projection from N to 
[s], : iV —>■ [s], and O = {(nr(A(z, j)), ns(i?(i, j))) | i,j G N}. The Latin squares A 

and B are said to be doubly orthogonal if there exist projections fl^ and such that O 
can be partitioned into r x s subarrays with the cells of each subarray containing the rs 
ordered pairs (x, y) where 0 ^ a; ^ r — 1 and 0 ^ ^ s — 1. 

An m? X array is said to be a Sudoku Latin square, on the set X of size m^, if it 
is a Latin square and we can label the rows by (p, s), 0 ^ p, s ^ m — 1 and columns by 
{q,t),0^q,t^m — 1 such that for each p and q the subarray dehned by the cells 

0 ^ s,t ^m-1, 

contains each entry of X precisely once. A mn x mn array is said be a quasi-Sudoku Latin 
square, on the set X of order mn, if it is a Latin square and we can label the rows by 
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{p,s),0^p^m — 1, O^s^n — 1 and columns {q,t), 0 ^ q ^ n — 1, 0 ^ t ^ m — 1 
such that for each p and q the subarray dehned by the cells 

((P) -s); (o') ^))) 0 ^ s ^ n — 1 , 0 ^ ^ m — 1 , 

contains each entry of X precisely once. Two Sudoku Latin squares or quasi-Sudoku Latin 
squares are orthogonal (doubly orthogonal) if they are orthogonal (doubly orthogonal) 
Latin squares. 


3 Construction of Doubly Orthogonal Quasi-Sudoku 
Latin Squares 

Here, we construct quasi-Sudoku Latin squares which are doubly orthogonal using sets 
of (pairwise) orthogonal Latin squares. This is done by hrst using a direct product 
construction to construct orthogonal quasi-Sudoku Latin squares and then showing that 
they are doubly orthogonal. 

For the remainder of this section we will take Ai and A 2 to be two Latin squares of 
order m and n, respectively. We can construct a new Latin square of order mn by taking 
the direct product, Ai ® yl 2 , of Ai with A 2 , where {Ai{p, q), ^ 2 ( 5 , t)) is the element in row 
np + s and column nq + t of Ai ® A 2 , O^p, q^m — 1 and 0 ^ s,t ^ n — 1. Label the 
rows of Ai ® A 2 as (p, s) and the columns of Ai ® A 2 as {q,t). For hxed p and q, the 
subarray dehned by the set of cells {((p, s), {q,t)) \ 0 ^ s,t ^ n — 1 } is then isomorphic 
to A 2 . 

The next proposition attests that orthogonality is maintained under the direct product. 
For a proof, see Denes and Keedwell |2] page 427. 

Proposition 3.1. If Ai and Bi are orthogonal Latin squares of order m and A 2 and B 2 
are orthogonal Latin squares of order n, then Ai ® A 2 and Bi ® B 2 are orthogonal Latin 
squares of order mn. 

An example of orthogonal Latin squares Ai 0 A 2 and Bi ® B 2 , constructed using the 
orthogonal Latin squares shown in Figureis described in Section]^ and shown in Figure 

El 

Proposition 3.2. If Ai and Bi are orthogonal Latin squares of order m and A 2 and B 2 
are orthogonal Latin squares of order n, then Ai ® A 2 and Bi ® B 2 are doubly orthogonal 
quasi-Sudoku Latin squares of order mn. 
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Proof. We begin by verifying that there exists an arrangement of the rows of both arrays 
Ai ® A 2 and Bi 0 B 2 which verihes that they are quasi-Sudoku latin squares. 

For hxed q, the entries Ai{p,q) and Bi{p,q) take the values in column q of Ai and 
Bi respectively. That is, for hxed g, {Ai{p,q) — 1} = {Bi{p,q) | 0 ^ p ^ 

m — 1} = [m]. Likewise, for hxed s, the entries A 2 {s,t) and B 2 {s,t) take values in row s 
of A 2 and B 2 , respectively. That is, for hxed s, {A 2 {s,t) — 1} = {B 2 {s,t) \ 

— 1} = [n]. Thus for hxed q and s 

[m]x[n] = {(Ai(p, g), ^ 2 ( 5 , t)) I 0 ^ p ^ m — 1, 0 ^ t ^ n — 1} 

= {(i?i(p, g), i? 2 (s, t)) I 0 < p ^ m - 1, 0 ^ ^ n - 1}. 

Hence we will assume that the rows of Ai ® A 2 and Bi ® B 2 have been reordered by 
moving row np + s to position ms + p, where 0 ^ p ^ m — 1 and 0 ^ s ^ n — 1. The 
order of the columns, however, remains as qn + f, where 0 ^ g ^ m — 1 and 0 ^ ^ n — 1. 

Now for hxed s and g the subarrays of Ai ® A 2 and Bi ® B 2 dehned by the intersection of 
rows ms + p with columns qn +1, where 0 ^ p ^ m — 1 and 0 ^ ^ n — 1 contains each 

of the mn entries precisely once. Note that the reordering of rows has been consistently 
applied to both Ai ® A 2 and Hi ® H 2 , therefore these Latin squares are still orthogonal. 

We select two onto functions H^ : [m] x [n] —)■ [m] and n„ : [m] x [n] —)■ [n] such that if 
n„,(Hi(p,g),H 2 (s,t)) = n,„(Hi(p,g),H 2 (s,T)) then t 7 ^ t' and if n„(Hi(p, g), ^ 2 ( 5 , t)) = 
n„(Hi(p, g), H 2 (s, T)) then t = t'. Such functions are not hard to hnd for instance we 
could take 


n,„(Hi(p,g),H 2 (s,t)) = Hi(p,g)and 
n„(Hi(p,g),H2(s,t)) = H2(s,t), 

or if m and n are coprime, with m > n, take 

n„,(Hi(p, g),H 2 (s,t)) = (n X Hi(p, g) + H 2 (s,t)) mod m and 

n„(Hi(p, g),H 2 (s,t)) = (n X Hi(p, g) + H 2 (s,t)) mod n. 

In this latter case since m and n are coprime and m > n, for hxed g, {n x Hi(p, g) mod m \ 

O^p^m — 1 } = [m] and since ^ 2 ( 5 , t) < m, {n x Hi(p, g) + ^ 2 ( 5 , t) mod m | 0 ^ p ^ 

m — 1 } = [m], so for any hxed g, s and t, {nm((^i(p, g), ^ 2 (-s, t))) | 0 ^p^m — 1 } = [m]. 
Further, {(nm((Hi(p, g), ^ 2 ( 5 , t))), (n„((Hi(p, g), ^ 2 ( 5 , t))) |0^p^m-l,0^t^n} = 
[m] X [n]. This verihes that Ai ® A 2 and Hi 0 H 2 are doubly orthogonal quasi-Sudoku 
squares. 

□ 


5 



It should be noted that the different projections given in the above proof produce 
non-isomorphic squares. This will be illustrated in the example given below. For m = n, 
the extension of these pairwise properties to more than two orthogonal direct product 
designs is immediate, if the component designs are available. Further, it should be noted 
that when we write Ai ® A 2 and Bi 0 B 2 are orthogonal quasi-Sudoku Latin squares we 
are assuming that the rows of the direct products have been rearranged to the required 
format for Sudoku Latin squares. 


4 An Example 


As an illustration, we will construct doubly orthogonal quasi-Sudoku Latin squares of 
order 12. We begin with two orthogonal Latin squares of order n = 3 and two of the 
three orthogonal Latin squares of order m = 4, as shown in Figure Note it does not 
matter which two orthogonal Latin squares of order 4 we choose, so we arbitrarily select 
the first and the last. In general, if the underlying Latin squares are non-isomorphic 
then it is possible to construct sets of non-isomorphic doubly orthogonal quasi-Sudoku 
Latin squares. In Figure]^ we construct Ai 0 A 2 and Bi 0 B 2 using the direct product 
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Figure 2: The three (pairwise) orthogonal Latin squares of order 4 and the two orthogonal 
Latin squares of order 3. 

construction. To facilitate understanding, rows and columns have been labelled and {x, y) 
has been replaced by xy. In Figure the rows have been reordered as first (p, 0) for 
0 ^ p ^ 3, then (p, 1) for 0 ^ p ^ 3, then (p, 2) for 0 ^ p ^ 3 to emphasise the fact that 
these squares are quasi-Sudoku Latin squares. 

In Figure we project down each subsquare in Figure by applying the mappings 
114 : [4] X [3] —)• [4] and Ha : [4] x [3] —)■ [3], given by 

n 4 ((Ai(p,g), A 2 (s,f))) = (3 X Ai(p,g)-F A 2 (s,f)) mod 4, and 
n 3 (( 5 i(p, g), 52 (s,f))) = (3 X 5i(p, g)-h 52 (s,f)) mod 3, 

to the entries in the quasi-Sudoku squares obtained by reordering the rows of the Latin 
squares Ai 0 A 2 and Bi 0 B 2 and label these as 114(^1 0 A 2 ) and n 3 (i?i 0 B 2 ). Then, 
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in Figure we superimpose the projections n4(yli ® A2) and n3(i?i ® B2) to verify that 
indeed Ai ® A2 and Bi ® B2 are doubly orthogonal quasi-Sudoku Latin squares of order 
12 , as each 4 x 3 subsquare has each of the ordered pairs {x,y), 0 ^ x ^3 and 0 ^ y ^ 2 . 
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Figure 3 : A pair of orthogonal Latin squares of order 12 
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Figure 4 : A pair of orthogonal quasi-Sudoku Latin squares of order 12 . 

If the projections 114 and Ila, given above, are replaced by the projections 
n4((Ai(p,g), A2(s,f))) = Ai{p,q), and 

we obtain the projected square given in Figure Note that here each of the twelve sub¬ 
squares can be obtained by reordering the rows and/or the columns of the hrst subsquare. 














U^iAi 0 A 2 ) 
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Figure 5 : Orthogonal quasi-Sudoku Latin squares under projections 114 and Ha. 


This is not the case for the projected square given in Figure To see this consider the 
hrst subsquare and any of the subsquares on rows 01 , 11 , 21 and 31 of Figure setwise 
the rows of these subsquares do not equal any row in the hrst subsquare. 
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Figure 6: The projected squares verifying that 0^2 and Bi®B2 are doubly orthogonal 
quasi-Sudoku Latin squares of order 12 . 

5 Quasi-Sliced Orthogonal Arrays 

A (symmetric) orthogonal array, denoted OA{N, k, s,t), is an N x k array with entries 
chosen from the set [s] of levels such that for every N xt submatrix the s* level combina- 

t 

, -\ 

tions of [s] X ■ ■ ■ X [s] each occur a constant number of times. We dehne a sliced symmetric 
orthogonal array to be an OA{N, k, s,t), O, which satisfies the following property: 

- there exists a projection If from [s] to [sq], Sq < s, and a partition of the rows of O 
into z/ subarrays, Oi, such that when the s levels of [s] are collapsed according to 
the projection If each Oi forms a symmetric OA{Nq, k, Sq, t). 

We say {Oi, O2, ■ ■ ■, Oy) is a sliced symmetric orthogonal array. 

For a k factor design, let S = {si,..., Sk} denote the list of numbers of factor levels. 
An asymmetric orthogonal array, denoted OA{N,k, S,t), is an N x k array, where the 
jth column contains entries of [sj], sj G S, and for each f-subset T of columns, the 
N X t submatrix defined by these columns contains all Si tuples of 
Cartesian product of [sj], i E T) a constant, Xt, number of times. We dehne a guasi-sliced 
asymmetric orthogonal array to be an OA{N, k, S, t) array, O, which satishes the following 
property: 
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114(^1 ® A2), n3(i?i ® B2) 



Figure 7 : The projected squares verifying that 0^2 and Bi®B2 are doubly orthogonal 
quasi-Sudoku Latin squares of order 12 . 

- there exist projections flj ; [sj] —)■ [s'] for f = 1 ,..., /c and a partition of the rows O 
into z/ subarrays, ( 9 *, such that when the sets of levels [si],..., [s^j are respectively 
collapsed onto ..., s' < Sj, each Oi is an asymmetric OA{Nq, k, S',t), 
S' = {s'4,s'2,...,s'J. 

More precisely (Oi,..., O^) is said to be a quasi-sliced asymmetric orthogonal array. In 
the above dehnition we note that if each projections is not one-to-one then it is immediate 
that s' < Sj, for all i. 

Proposition 5 . 1 . If Ai and Bi are pairwise orthogonal Latin squares of order m and A2 
and B2 are pairwise orthogonal Latin squares of order n. Then there exists a quasi-sliced 
asymmetric orthogonal array OA{m‘^n‘^, 4 , {mn}, 2 ). 

Proof. “Unstack” the pair of orthogonal quasi-Sudoku Latin squares A11S1A2 and Bi®B2 
to obtain an orthogonal array OA{mfn^, 4 :, {mn},2), O, where row (r, c) of O takes the 
form 

r, c, (Ai (g) A2)(r,c), {Bi®B2){r,c) . 

To verify that this is a quasi-sliced asymmetric orthogonal array we hrst provide details 
of the partitioning of the rows and then the projections. 
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Recall that the rows of the reordered squares Ai®A 2 and Bi®B 2 are labelled as (p, s), 
0 ^ p ^ m — 1 and 0 ^ s ^ n — 1 and the columns are labelled as (g, t), 0 ^ g ^ m — 1 
and 0 ^ ^ n — 1. Now for fixed q let Oq be the (mn^) x 4 subarray with rows indexed 

by ((p, s),{q,t)), 0 ^ p ^ m — 1 and 0 ^ s, t ^ n — 1, where a row takes the form 

{P,s), {q,t), A2){{p,s),{q,t)),{Bi® B2){{p,s),{q,t)) ■ 

Focusing on the rows corresponding to the subarray Oq, before we apply the projections 
ffi, 112 , Ifs, 114 , we see that for columns 1, 3 and 4 the set of levels is {(p, s) | 0 ^ p ^ 
m — 1,0 ^ s ^ n — 1}, for column 2 the set of levels is {{q,t) | 0 ^ f ^ u — 1}. Next 
apply the projections 

fli : (p,s)-)'S 

B-2 ■ (qA) t 

ffs = 

114 = n„ 


where flm and fl^ are dehned in the proof of Proposition 3^ Note that each of these 
projections is not one-to-one. 


Finally we need to prove that Oq is a asymmetric orthogonal array with parameters 
OA{mrA, 4, S', 2) where S' = {n, n, m, n}. 

Note columns 3 and A oi Oq, are the concatenation of the n sets of pairs 

{(nm(v4i(p, q), A 2 {s, t)), Iln{Bi{p, q), B 2 {s, t))) \ 0 A P A m - 1,0 A t A n - 1}] 


one set for each 0 ^ s ^ u — 1. The set {(Ilm{Ai{p,q), A 2 {s,t)),Iln{{Bi{p,q), B 2 {s,t))) \ 
OApA'm — l,0AtAn — 1} = [m] x [n\. Hence columns 3 and 4 are the concatenation 
of n copies of [m] x [n]. 

For hxed s the set of pairs {(s, nm(^i(p, q), ^ 2 ( 5 , t))) |0^p^m — — 1} 

gives n copies of {s} x [m] and {(s, (n„(i?i(p, g), R 2 (s, t))) |0^p^m — 
gives m copies of {s} x [u]. So, respectively, as s takes the values 0,... ,u — 1 we obtain 
n copies of [n] x [m] and m copies of [n] x [n]. 

For hxed s the set {{t, nm(^i(p, g), ^ 2 ( 5 , t))) |0^p^m — — 1} gives one 

copy of [n] X [m]. So as s takes the values 0,..., n—1 we obtain n copies of [n] x [m]. Finally 
as s takes the values 0,..., n — 1 {{t, n„(Ri(p, q), B 2 {s,t))) |0^p^m — — 1} 

gives m copies of [n] x [n]. 

Thus each Oq, for O^g^m — lisan asymmetric orthogonal array with the required 
parameters. In all cases the projections are not one-to-one and the results is a quasi-sliced 
asymmetric orthogonal array as required. □ 
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Once again, for m = n, the extension of these pairwise properties to it' > 2 orthogonal 
direct product designs OA{rn?n^, 2 + K, {mn}, 2) is immediate, if the component designs 
are available. 

By way of example we project the hrst three columns of the array given in Figure 
to obtain the quasi orthogonal array Oq {q = 0 ) with parameters 0 ^ 4 ( 36 , 4 , S", 2 ), where 
^' = { 3 , 3 , 4 , 3 }. 

(^0 

000000000000111111111111222222222222 

012012012012012012012012012012012012 

012301230123120013302231201130023312 

012012012012201201201201120120120120 

Figure 8: The projected sliced array Oq. 

6 Construction of Quasi-Sudoku-Based Sliced Space- 
Filling Designs 

Sliced space-hlling designs can be constucted from the doubly orthogonal quasi-Sudoku 
Latin squares or the quasi-sliced asymmetic orthogonal array using the techniques in [ 5 ] , 
[7], and jOj. In brief, the column-wise procedure is as follows. First, randomly relabel 
each column’s elements l,...,mn subject to the constraint that the elements mapped 
to the same symbol by fl form a consecutive subset of l,...,mn. Next, replace the 
elements in each column with symbol k with a random permutation of {k — l)mn + 
1 ,..., (/c — l)mn -|- mn. Lastly, each element of the space-hlling is generated as {xij — 
Uij)/{mnY, where Xij denotes the design elements after the hrst two steps and Uij denotes a 
random Uniform( 0 , 1 ) deviate. As an example. Figure |^shows a sliced space-hlling design 
constructed based on the quasi-sliced asymmetic orthogonal array whose hrst sliced is 
shown in Figure]^ 

As shown in [ 5 ] and [ 9 ], the complete design achieves uniformity in one and two- 
dimensional projections, while the slices are guaranteed to achieve uniformity in two- 
dimensional projections. On the other hand, the columns based on the doubly orthogonal 
quasi-Sudoku Latin squares can be divided into a larger number of slices, as dehned by 
the quasi-Sudoku sub-squares, each of which has guaranteed uniformity under one and 
two-dimensional projections, as shown in [ 9 ]. 
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Figure 9 : Sliced space-filling design based on a quasi-sliced asymmetic orthogonal array. 
Slices indicated by point labels. 
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